Optimization problems for machine learning: A survey
نویسندگان
چکیده
This paper surveys the machine learning literature and presents in an optimization framework several commonly used approaches. Particularly, mathematical models are presented for regression, classification, clustering, deep learning, adversarial as well new emerging applications teaching, empirical model Bayesian network structure learning. Such can benefit from advancement of numerical techniques which have already played a distinctive role settings. The strengths shortcomings these discussed potential research directions open problems highlighted.
منابع مشابه
Machine learning problems from optimization perspective
Both optimization and learning play important roles in a system for intelligent tasks. On one hand, we introduce three types of optimization tasks studied in the machine learning literature, corresponding to the three levels of inverse problems in an intelligent system. Also, we discuss three major roles of convexity in machine learning, either directly towards a convex programming or approxima...
متن کاملMachine learning based decision support for many-objective optimization problems
Multiple Criteria Decision-Making (MCDM) based Multi-objective Evolutionary Algorithms (MOEAs) are increasingly becoming popular for dealing with optimization problems with more than three objectives, commonly termed as many-objective optimization problems (MaOPs). These algorithms elicit preferences from a single or multiple Decision Makers (DMs), a priori or interactively, to guide the search...
متن کاملHessian Free Optimization Methods for Machine Learning Problems
In this article, we describe the algorithm and study the performance of a Hessian free optimization technique applied to machine learning problems. We implement the commonly used black box model for optimization and solve a particular challenging recursive neural network learning problem, which exhibits a non-convex and non-di erentiable function output. In order to adapt the method to machine ...
متن کاملOptimization for Machine Learning
This is a draft containing only sra chapter.tex and an abbreviated front matter. Please check that the formatting and small changes have been performed correctly. Please verify the affiliation. Please use this version for sending us future modifications.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: European Journal of Operational Research
سال: 2021
ISSN: ['1872-6860', '0377-2217']
DOI: https://doi.org/10.1016/j.ejor.2020.08.045